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(54) Method and apparatus for modulating lighting in a rendering pipeline 

(57) An apparatus generates lighting modulation 
factors for samples in a volume rendering pipeline. The 
apparatus includes a first arithmetic logic unit squaring 
a gradient magnitude vector of a sample to produce a 
squared gradient magnitude. A second arithmetic logic 
unit produces a gradient magnitude from the squared 
gradient magnitude. A shift register, connected to the 
first arithmetic logic unit, truncates a predetermined 
number of high bits of the squared gradient magnitude. 
A gradient magnitude modulation register stores modu- 
lation parameters. A first multiplexer, connected to the 
second arithmetic logic unit and the shift register, 
selects the truncated squared gradient magnitude as an 
index if an index source signal is true, and the gradient 
magnitude if the index source signal is false, and a 
memory table is indexes by the index to produce modu- 
lated opacity, emissive, diffuse and specular modulation 
factors. 
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Description 

CROSS REFERENCES TO RELATED APPLICATIONS 

5 [0001] This application is a continuation in part of U.S. Patent Application Serial No t 09/190,643 (attorney docket 
number VGO-1 09) "Fast Storage and Retrieval of Intermediate Values in a Real-Time Volume Rendering System," filed 
by Kappler et al. on Nov. 12, 1998. 

FIELD OF THE INVENTION 

w 

[0002] This invention relates generally to volume rendering, and more particularly to modulating lighting using gradi- 
ent magnitudes of samples. 

BACKGROUND OF THE INVENTION 

15 

Introduction to Volume Rendering 

[0003] Volume rendering is often used in computer graphics applications where three-dimensional data need to be 
visualized. The volume data can be scans of physical or medical objects, or atmospheric, geophysical, or other scientific 
20 models where visualization of the data facilitates an understanding of the underlying real-world structures represented 
by the data. 

[0004] With volume rendering, the internal structure, as well as the external surface features of physical objects and 
models are visualized. Voxels are usually the fundamental data items used in volume rendering. A voxel is a data item 
that represents a particular three-dimensional portion of the object or model. The coordinates (x, y t z) of each voxel map 
25 the voxels to positions within the represented object or model. 

[0005] A voxel represents some particular intensity value of the object or model. For a given volume, intensity values 
can be physical parameters, such as, density, tissue type, elasticity, velocity, to name but a few. During rendering, the 
voxel values are converted to color and opacity (rgba) values which can be projected onto a two-dimensional image 
plane for viewing. 

30 [0006] One frequently used technique during rendering is ray-casting. A set of imaginary rays are cast through the 
array of voxels. The rays originate from a viewer's eye or from an image plane. The voxel values are re-sampled to 
points along the rays, and various techniques are known to convert the sampled values to pixel values. Alternatively, 
voxel values may be converted directly to rgba voxels, which are then re-sampled along rays and accumulated to pixel 
values. In either case, processing may proceed back-to-front, or front-to-back. 

35 

Rendering Pipeline 

[0007] Volume rendering can be done by software or hardware. In one hardware implementation, the hardware is 
arranged as a multi-stage pipeline, see U.S. Patent Application 09/190,643 "Fast Storage and Retrieval of Intermediate 
40 Values in a Real-Time Volume Rendering System," filed by Kappler et al. on Nov. 12, 1998. 

Illumination 

[0008] Illumination is well-known in both art and computer graphics for increasing the realism of an image by adding 
45 highlights, reflections, and shadows, thereby appealing to one of the natural capabilities of the human eye to recognize 
three-dimensional objects. A number of prior art illumination techniques are known in computer graphics, generally 
involving complex calculations among the directions to each of the light sources, normal vectors to surfaces, and the 
position of the viewer. In polygon graphics systems, where the three-dimensional objects are depicted by partitioning 
their surfaces many small triangles, the normal at each point on a surface is easily obtained from the specification of 
so the triangle containing that point. 

[0009] Naturally, it is a challenge for any graphics system to carry out these calculations quickly enough for real-time 
operation. One technique for performing them efficiently is described by Voorhies et al. in "Reflection Vector Shading 
Hardware," Computer Graphics Proceedings, Annual Conference Series, pp. 163-166, 1994. They describe a polygon 
graphics system in which the calculations involving the eye vector and light sources are partially pre-computed for a 
55 fixed set of directions and stored in lookup tables. During rendering, reflection vectors are used to index into these 
tables to obtain values for modulating the intensities of the red, green, and blue colors assigned to the points on the 
surfaces of the objects depicted in the image. The only calculations necessary in real-time are for obtaining reflection 
vectors themselves and for applying the modulation. 
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[0010] Applying illumination in volume graphics is more difficult because there are rarely any defined surfaces in a 
volume data set. Instead, visible surfaces must be inferred from the data itself, as discussed by Levoy in "Display of Sur- 
faces From Volume Data," IEEE Computer Graphics and Applications, May, 1988, pp. 29-37. A common technique is 
to calculate gradients throughout the volume data set, that is the rates and directions of change of the voxel values with 

5 respect to position. At points where the gradient is strong, a surface or boundary between material types can be 
inferred, with the gradient pointing in the direction of the normal to the surface. The magnitude of the gradient indicates 
the sharpness of the surface. Traditional illumination techniques are then applied to modulate the color intensity and 
alpha values according to both the magnitude and direction of the gradient at each point in the volume, for example as 
described by Drebin, et al., in "Volume Rendering," Computer Graphics, August 1988, pp. 65-74. By this method, fea- 

w tures which exhibit high gradient magnitudes are accentuated as surfaces, while features which exhibit low gradient 
magnitudes are suppressed. 

[0011] Terwisschavan van Scheltinga et al. in "Design of On-Chip Reflectance Map," Eurographics 95 Workshop on 
graphics Hardware, pp. 51-55, 1995, describe an application of the technique of Voorhies et al. to volume rendering. In 
that technique, specular and diffuse intensities are pre-computed based on directions to light sources and the eye of 
15 the viewer. The intensities are then stored in lookup tables called reflectance maps. Gradient vectors are used to index 
into these tables to obtain the intensities for modulating rgba values at sample locations in order to produce specular 
and diffuse highlights. 

[0012] The above illumination techniques suffer from an inability to distinguish object surfaces from noise. Meaningful 
illumination can only take place when the samples can unequivocally be classified as surface or non-surface samples. 

20 Prior illuminators are inadequate because the presence of noise can cause them to assign strong illumination to voxels 
within homogeneous material. Neither Voorhies nor van Scheltinga suggest, teach or show illumination in a pipelined 
manner. Furthermore, the above techniques suffer a performance penalty in having to reload the reflectance maps any- 
time a view on an object changes. They do suggest computing a specular reflection vector on-the-fly, based on the gra- 
dient and eye vectors, which would obviate the need to reload the specular reflectance map when the view direction 

25 changes. 

Gradient Magnitude Approximation 

[0013] In the past, the brute force approach to determining gradient magnitudes included obtaining the sum of the 
30 squares of the gradient vector components (u, v, w) of the gradient vector G uvw , then deriving the square root of the this - 
sum. This computation can be extremely hardware intensive, so software is often used. This is because the number of 
iterations necessary in doing a traditional square root calculation can be on the order of tens of steps. 
[0014] The hardware necessary and the time allotted for such calculations is exceedingly complex and long, espe- — 
cially in view of a requirement for a real-time volume rendering, that needs to render at a rate of more than 500 million 
35 samples per second. Mother prior art method for deriving gradient magnitude is by utilizing look-up tables, which suffers 
from the problem of the large number of gates required for any reasonable level of precision. 
[0015] After having derived gradient magnitudes, it is desirable to provide the user with the ability to use the gradient 
magnitude to interactively modify the application of lighting or a sample's opacity. This gives the user the ability to 
accentuate certain features, the ability to cut out certain features, or the ability to create a wide variety of alterations to 
40 the rendered object. 

[0016] It is desired to improve on these prior art deficiencies while illuminating volume data. More particularly, it is 
desired to perform efficient and flexible The invention provides lighting modulation factors for samples in a volume ren- 
dering pipeline. An apparatus that generates the factors includes the following. 

[0017] A first arithmetic logic unit squares a gradient magnitude vector of a sample to produce a squared gradient 
45 magnitude. 

[0018] A second arithmetic logic unit produces a gradient magnitude from the squared gradient magnitude. 

[0019] A shift register, connected to the first arithmetic logic unit, truncates a predetermined number of high bits of 

the squared gradient magnitude. 

[0020] A gradient magnitude modulation register stores modulation parameters. A first multiplexer, connected to the 
so second arithmetic logic unit and the shift register, selects the truncated squared gradient magnitude as an index if an 
index source signal is true, and the gradient magnitude if the index source signal is false, and a memory table is indexes 
by the index to produce modulated opacity, emissive, diffuse and specular modulation factors, illumination as a stage of 
a hardware pipeline. 

55 SUMMARY OF THE INVENTION 

[0021] The invention provides lighting modulation factors for samples in a volume rendering pipeline. An apparatus 
that generates the factors includes the following. A first arithmetic logic unit squares a gradient magnitude vector of a 
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sample to produce a squared gradient magnitude. 

[0022] A second arithmetic logic unit produces a gradient magnitude from the squared gradient magnitude. A shift 
register, connected to the first arithmetic logic unit, truncates a predetermined number of high bits of the squared gra- 
dient magnitude. 

5 [0023] A gradient magnitude modulation register stores modulation parameters. A first multiplexer, connected to the 
second arithmetic logic unit and the shift register, selects the truncated squared gradient magnitude as an index if an 
index source signal is true, and the gradient magnitude if the index source signal is false, and a memory table is indexes 
by the index to produce modulated opacity, emissive, diffuse and specular modulation factors. 

10 BRIEF DESCRIPTION OF THE DRAWINGS 



[0024] 



Figure 1 


is 


a block diagram of a rendering pipeline that uses the invention; 


Figure 2 


is 


a block diagram of an illumination stage of the pipeline according to the invention; 


Figure 3 


is 


a block diagram of a gradient magnitude modulation unit; 


Figure 4 


is 


a block diagram of a gradient magnitude range register; 


Figure 5 


is 


a block diagram of a gradient magnitude modulation register; 


Figure 6 


is 


a graph of a high pass filter function; 


Figure 7 


is 


a block diagram of an attenuation function; 



Figure 8a is a block diagram of a reflectance mapping unit; 
30 Figure 8b is a block diagram of a circuit for computing reflection vectors; 
Figure 9 is a block diagram of an eye vector register; 

Figure 10 illustrates the reflection of an eye and reflection vector about a surface normal; 

35 

Figure 1 1 is a block diagram of a lighting unit of the illumination stage; 
Figure 12 is a graph the Newton-Raphson square root approximation; 
40 Figure 13 is a block diagram of a pipelined square root approximation unit; and 
Figure 14 is a graph comparing approximation results. 
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

45 

[0025] Figure 1 shows a pipeline 100 that uses an illumination stage 200 according to the invention. The input to the 
pipeline is voxels 102 read from a voxel memory 101 , and the output of the pipeline is pixels 1 08 written to a pixel mem- 
ory 109. 

[0026] The stages of the pipeline 1 00 interpolate 1 1 0 the voxels 1 02 for a particular point of view to produce samples 
so 103. During interpolation, the neighborhood of a voxel is examined, and values are assigned to sample points along 
rays. Typically, re-sampling funct ions include linear, probabilistic, or nearest neighbor interpolation. 
[0027] The samples 103 have their gradients 104 estimated 120. Gradients indicate the direction and magnitude of 
surface normals. The samples 103 are then classified. The classified samples are illuminated according to the invention 
using the estimated gradients 104 in stage 200. Last, the illuminated samples 106 are composited 140 to pixel values 
55 108. In other embodiments, the order of the interpolation, gradient estimation, and classification stages may be differ- 
ent. 

[0028] The flow of data in the pipeline of Figure 1 makes it possible to achieve considerable parallelism in a semicon- 
ductor or hardware implementation. While one group of data are being read from voxel memory 101, a previously read 
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group is interpolated in the interpolation stages 1 10, a group read before that is having gradients estimated and being 
classified in stages 120, etc. The pipeline reads a fixed number of voxels in each cycle, and these progress through the 
pipeline stage-by-stage and cycle-by-cycle. Therefore, even though the number of stages and length of time needed for 
rendering an individual voxel or sample may be large, many voxels are processed at any one time. 

5 

Illumination Stage 

[0029] Figure 2 shows an illumination stage 200 for a hardware rendering pipeline according to the invention. The 
stage 200 includes three major units, namely gradient magnitude modulation 300, reflectance mapping 800, and light- 
10 ing 1 100. The stage 200 also includes four arithmetic logic units (ALUs), i.e., multipliers (®) 201-204, and a multiplexer 
(MUX) 210. 

[0030] Each input to the stage 200 comprises an already classified sample 205 from the previous stage, its corre- 
sponding gradient vector (G UvW ) 104, and an eye vector (E uvw ) 801 representing the direction from the sample point 
to the eye of the viewer. The sample and its associated gradient vector are received at the rate of one pair per pipeline 

15 clock cycle. In a system in which volume rendering produces a parallel projection, the eye vector is constant throughout 
the volume. However, in the case of perspective projection, the eye vector must be adjusted for each ray. 
[0031] The illumination stage 200 applies specular (s), diffuse (d) and emissive (e) lighting to the classified sample 
205 using its associated gradient vector (G UV w) 104, and other controls described in detail below. The illumination 
stage 200 according to the invention, in pipeline fashion, processes sample and vectors at the rate of one pair per pipe- 

20 line clock cycle. That is, it comprises a fixed number of processing steps, and data flows through the stage in one direc- 
tion from beginning to end. There are no loops, feedback, or variation in the number of steps of processing. Each of the 
sub-units of illumination stage 200 is likewise organized in pipeline fashion to accept inputs at the rate of one per cycle 
and to product outputs at the same rate. 

[0032] The gradient vector 104 is provided as input to the modulation unit 300, and the reflectance map unit 800, 
25 described below. The modulation unit generates four gradient magnitude modulation factors GMOM, GMIM e , GMIM d , 
and GMIM S . GMOM is the factor for opacity modulation, and the other three factors modulate color (RGB) intensities for 
emissive (e), diffuse (d), and specular (s) lighting, respectively. Modulation can be done in a number of different ways 
under user control. 

[0033] GMOM modulates or attenuates (201) the alpha (opacity) component 206 of the classified sample 205, sup- 
30 plied via the mux 210. The mux 210 also receives G uvw in the case that the illumination stage is bypassed altogether. 
GMIM e is multiplied in 202 by ke where ke represents the intensity of the emissive lighting, a constant for the entire vol- 
ume. The modulated kg is denoted by Mlv GMIM d is supplied in 203 by l d to produce a modulated diffuse intensity Ml d . 
GMIM S is multiplied in 204 by l s to produce a specular lighting intensity Ml s . The values l d and l s are provided via the 
reflectance mapping unit 800. Mke, Ml d , and Ml d are inputs to the Lighting unit 1100, as described in Figure 11. 
35 [0034] The main output of the illumination stage 200 is an illuminated sample 106 with Red, Green, Blue color com- 
ponents, and an Alpha components. The other two outputs are GmRangeValid 1 07, and the sign 1 08 of the dot product 
of the gradient vector and the eye vector (Guvw * E uvw)- The value GmRangeValid is the result of comparing the com- 
puted gradient magnitude squared against a range defined in a range register. This signal can be used downstream in* 
the compositing stage 140 of the pipeline 100 to further modify the resultant image by selectively including or excluding 
40 samples from being composited based upon their gradient magnitude. 

[0035] The sign of the dot product indicates whether the gradient is front-facing or back-facing. This signal can also 
be used downstream in the compositing stage to identify a sample as being on a front-facing or back-facing surface. 
With this information, a simple segmentation of the volume data is possible. Like the input, the output is also clocked at 
the rate of one illuminated sample pipeline cycle. 

45 

Gradient Magnitude Modulation 

[0036] Figure 3 shows the gradient magnitude modulation unit 300 in greater detail. The purpose of the unit is to filter 
gradients using their magnitudes. Filtering accentuate surfaces, and removes noise. 

so [0037] The unit 300 includes an arithmetic logic unit 310 for taking the dot product of the gradient 104 with itself 
(G uvw • G uvw )> thereby obtaining the square of its magnitude |G 2 |, and a unit 600 {is this the right number ?} for taking 
the square root of |G 2 | described in greater detail with reference to Figures 1 2 and 1 3. The output of the squaring circuit 
310 is supplied to a comparator 320 along with range values from a GradientMagnitudeRange register 400 shown in 
Figure 4. The range values include a minimum and maximum valid magnitude. The output is also truncated by circuit 

55 330, for example, a shift register, and then supplied to the multiplexer 340 along with |G|. 

[0038] The output of the mux 340 is used to index a gradient magnitude look-up table (GMLUT) 380, the entries of 
which are representations of fractional numbers in the range zero to one, inclusive. The absolute value |G| is also pro- 
vided to a high pass filter (Hi-Pass) filter function 350. A signal selecting a particular modulation mode is provided on 
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line 360 to a multiplexer 370. 

[0039] This signal is derived from a gradient magnitude modulation register (GMM) 500 shown in Figure 5. The 
parameter values stored in the register 500 as bits can be supplied by the user. Possible modes include various com- 
binations of specular, diffuse, emissive, opacity, high pass diffuse, and high pass specular. 

5 

Gradient Magnitude Modulation Register 

[0040] As shown in Figure 5, the GMM 500 includes fields 501-507 stored as 32 bits. The various bits control exactly 
how the user desires to have the modulation performed. The grain, base, upper and lower range, and index source field 
w 501-504 are used in conjunction with the GMLUT 380. The two high pass fields 505-506 are used by the high pass func- 
tion 350. Field 505 specifies a step value for a high pass filter function. Field 506 eliminates either specular or diffuse 
lighting, or both. The values in field 507 select a complex modulation mode for the mux 370 using the magnitude look- 
up table 380. 

[0041] In other words, there are a total of thirty-two control bits in the GMM register 500 that control the application 
15 of the two modulation functions (Hi-Pass or GMLUT) to the four modulation outputs 390. GMOM and GMIM e can have 
either the GMLUT output or the value 1.0 applied to them based upon the setting of the modulateOpacity and 
modulateEmissive control bits 0 and 1, in the notation of the C programming language: 

GMOM = modulateOpacity ? GMLUT[\G\] : 1.0 
20 GMIM e = modulateEmissive ? GMLUT[\G\] : 1.0. 

[0042] Here, the "?" operator "asks" whether the named control bit is set or not in the GMM 500, and selects the first 
or second of the following two operands accordingly. GMIM d and GMIM S can have any of the four following values; 1.0, 
Hi-Pass (|G|), GMLUT [\G\], or Hi-Pass(\G\)*GMLUT[\G\]. 
25 [0043] Note, as shown above, it is possible to compound the two function values. Any of these four possible values 
can be independently selected for GMIM d and GMIM S as follows: 

GMIM d = (modulateDiffuse ? GMLUT[\G\] : 1.0) * {hiPassDiffuse ? Hi-Pass(\G\) : 1.0) 
GMIM S = (modulateSpecular ? GMLUT[\G\] : 1.0) * (hiPassSpecular ? Hi-Pass(\G\) : 1.0) 

30 

depending on the setting of the control bits of the GMM 500. 

Gradient Magnitude Modulation Operation 

35 [0044] The unit 300 determines the modulation (attenuation) factors GMOM, GMIM e , GMIM d , and GMIM S 390 accord- 
ing to the selection signal on line 360 and the gradient magnitude of the classified sample 205. The modulation factors 
can be applied to lighting parameters (l d , l s , and kg) and the opacity of the sample. 

[0045] The square (|G 2 |) of the gradient magnitude is computed in unit 310 by taking the sum of the squares of the 
components of the gradient vector as follows: 

40 

\G 2 \ = (G U *G U )+(G V *G V )+(G W *G W ) 

[0046] The gradient vector components are in the range of [-4095, .... +4095] 24 . Given this range, the range of the 
computed square of the gradient magnitude is [0 50,307,075]. The GmRangeValid signal 107 is set as follows: 

45 

GmRangeValid = (\G 2 \ > = GradientMagnitudeRange.Min) && (\G 2 \ < = GradientMagnitudeRange.Max). 

where the GradientMagnitudeRange register 400 is shown in Figure 4, and where "<&<&" is the logical AND operator 
notation of the C programming language. 
so [0047] The four modulation factors output by the modulation unit 300 are GMOM, GMlM e , GMIM d , and GMIM S 390. 
These outputs are in the range of [0.0, .... 1 .0]. As can be seen in Figure 2 using multiplication logic, GMOM modulates 
the opacity (alpha) component of the sample, GMIM e modulates k^, and thus emissive lighting, GMIM d modulates l d , 
and thus diffuse lighting, and GMIM S modulates l s , and thus specular lighting. 

[0048] This modulation can be used for a variety of reasons: minimize or eliminate lighting contributions of non-sur- 
55 faces; minimize or eliminate lighting contributions of samples with low gradients that might exist due to errors in sam- 
pling and/or interpolation or noise errors inherent in the volume data set; apply light to only those samples with 
gradients in a specific range; and include or exclude samples from being composited (GMOM). The modulation factor 
GMOM can, for instance, enable compositing of only homogenous regions by eliminating all surfaces or conversely, 
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enable compositing of only surfaces. 

[0049] As an advantage, two modulation functions are provided by the unit 300, namely a complex function using a 
gradient magnitude look-up table (GMLUT) 380, and the step filter function 350. 

s High Pass Filter Function 

[0050] The high pass filter function operates on the approximated gradient magnitude. This step function produces a 
high pass modulation factor of either 0.0 or 1 .0 to either side of a step value in the gradient magnitude range as defined 
by the hiPassStart field 505 of the GMM register 500, shown in Figure 5. The following equation represents the step 
10 function: 

hiPassOutput = (\G\ > = hiPassStart) ? 1.0 : 0.0 

[0051] Figure 6 shows an example output 600 for this step function. The x-axis depicts the lower-end of the input gra- 

15 dient's magnitude range [0 255], and the y-axis the magnitude of the high pass output. In this example, the step 

value hiPassStart is set to 96. Thus, for all samples with gradient magnitudes below 96, the output is 0.0, otherwise, the 
output is 1.0. 

Gradient Magnitude Look-up Table 

20 

[0052] As shown in Figure 3, the GMLUT 380 takes either |G|, or the most significant, for example, thirteen bits of |G 2 | 
as input. The selection through multiplexer 340 is controlled by the indexSource field 504 of the GMM register. The trun- 
cated magnitude squared is used if the indexSource signal is true, and the magnitude |G| is used otherwise. 
[0053] Using |G| gives the user a linear function with GMLUT table entries spread at equal points across the selected 

25 gradient magnitude range. 

[0054] However, the square root approximation can be prone to error so it may be advantageous to use |G 2 | directly. 
Using the most significant bits of the |G 2 | yields a non-linear function with GMLUT entries packed closer together at the 
lower end of the gradient magnitude range. This is actually desirable and intended because most attenuation of lighting 
will be done at the low-end of the gradient magnitude range. 

30 [0055] The GMLUT is organized as 128 entries (entryO, .„, entry127). Each entry is eight bits wide and stores a value 
in the range [0.0, 1.0]. The look-up is controlled by the grain, base, upperRangeDefault and iowerRangeDefault 
fields 501-504 of the GMM register 500. These fields allow the user to specify how the 128 table entries are spread 
across the table's 13-bit index range. 

[0056] The base field 502 specifies where in the index range the first entry (entryO) of the table is indexed. The grain 
35 field 501 specifies how far apart the table entries are spread starting at the base entry. In other words, the grain is the" 
size of the incremental value between the entries. If the table is programmed to cover less than the 13-bit index range,* 
then the upper-RangeDefault and IowerRangeDefault fields 503-504 specify the GMLUT output value for the uncov^ : 
ered regions above and below, either region can be zero or one. 

[0057] Figure 7 shows an example complex attenuation function 700 where the x-axis indicates the gradient index in 
40 the range of [0, .... 4k-1], and the y-axis the GMLUT output value in the range [0.0, 1.0]. In this example, the base is 
1536, and the grain is 2. Interpolation is performed between the two nearest table entries, and an 8-bit repeating frac- 
tion result is produced, again representing the range of [0.0 1.0]. 

Reflectance Mapping 

45 

[0058] As shown in Figure 8a, the reflectance mapping unit 800 includes a diffuse reflectance map 810, and a spec- 
ular reflectance map 820. The unit also includes a reflectance vector circuit 830 for deriving a reflection vector 802 from 
an eye vector (E UV w) 801 and the gradient vector 104 (see also Figures 8b and 10). A mux 840 selectively chooses to 
index the specular reflectance map directly with either the gradient vector or the computed reflection vector 802. The 
so inputs to the units are the gradient and eye vectors 104, 801, and the outputs are the diffuse and specular intensities 
<l d , l s ) 803-804. 

[0059] The reflectance mapping unit 800 determines the specular and diffuse intensities (l s and l d ) for each sample 
205 based upon its associated gradient vector 104 and the user-specified eye vector (E uvw ) 801. As shown, the diffuse 
map 810 is indexed by the sample's gradient vector 104, whereas the specular map 820 is typically indexed by either 
55 the gradient vector or the computed reflection vector 802 depending on a bypass (bypassRefVec) signal 901 shown in 
Figure 9. 

[0060] The maps and the indexing vectors are all specified in unpermuted (U, V,W) object space but relative to "phys- 
ical" or "lighting" space. The advantage of this is that the reflectance maps do no have to be recalculated for different 
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view directions. However, gradients estimated from anisotropic or non-orthogonal volume data sets must be corrected 
to "physical" space for the lighting calculations to work correctly. The specular map 820 may be indexed directly by the 
gradient vector 104, instead of by the reflection vector 802, by setting a bit in a bypassRefVec field 901 in an EyeVector 
register 900 to true as shown in Figure 9. The other fields 902-904 of the register 900 respectively store the (U,V,W) 
s components of the eye vector. 

Reflection Vector 

[0061] Figure 10 shows the relationship between the eye, reflection, and gradient vectors. The eye vector 801 is 
10 defined to be the vector from the point on a "surface" of the volume 1 000 to the eye 1 001 . Its coordinates are specified 
in (UMW) object space by fields 902-904. Note, this vector is normalized to a length of 1. The reflection from a light 
source 1002 to the eye 1001 is dependent upon the gradient vector 104. 

[0062] As shown in Figure 8b, the reflectance vector circuit 830 derives the reflection vector 802 based upon the eye 
vector 801 specified by the EyeVector register 900 and the gradient vector 1 04. The gradient vector is not of unit length, 
15 i.e., it is unnormalized. Using arithmetic logic units (scaling unit 851, two dot product generators 852, two multipliers 
853, and adder 854), the circuit 830 determines an unnormalized reflection vector Ru as: 

Ru = 2*Gu*(Gu • E)-E(Gu • Gu) 

20 where Gu is the unnormalized gradient vector, and E are the reflection and eye vectors, and • is the "dot product" oper- 
ator of two vectors. Note, only the direction, and not magnitude, is important for the reflection vector to index the reflect- 
ance map. 

Reflectance Map 

25 

[0063] As previously mentioned, the specular and diffuse reflectance maps use the same organization. Each reflect- 
ance map is organized as a table with, for example, 1536 entries. The entries are spread across the six faces of an 
imaginary cube in 3D, that is 256 entries on each face. Each face includes four quadrants of 64 entries. The index to 
the maps are the unnormalized gradient vector or the reflection vector as selected by the mux 840. Again, magnitude 

30 is not important, but direction is. 

[0064] The outputs are values, interpolated from four entries of the map, based on the direction of the incoming vector. 
The selection of the face of the cube for access is based on the maximum vector component, and its sign. For instance, 
if the vector is (75,0,0) in (u,v,w) space, then the right face of the cube (positive U) would be chosen. Whereas, if the 
vector is (-75,0,0), then the left face of the cube is chosen. The quadrant of a face is then selected based upon the sign 

35 of the other two vector components. 

[0065] Finally, a cluster of four neighboring table entries is selected for interpolation to a resultant intensity value. This 
neighborhood is selected by computing two weights that indicate the angle of deflection of the vector from the center of 
the cube's face to the outer edges of the face. Given that there are a power-of-two entries in each direction of a face's 
quadrant and the vector's components are represented by a power-of-two value, these weights can easily be derived 

40 by simple bit extraction of the vector's components. 

Lighting 

[0066] Figure 1 1 shows the lighting unit 1 100 in greater detail. The unit comprises a number of arithmetic logic units 
45 (ALUs) that add (©) and multiply (®) signals derived by the modulation and mapping units, and clamps. The lighting 
unit 1 100 applies the diffuse and specular lighting coefficients, and kg, the modulated emissive, diffuse, and specular 
intensities (Mkg, Ml d , Ml s ), and the specular color (Rg, G s , B s ) 1 101 to the classified RGBa sample 205. 
[0067] The lighting equations, implemented by the ALUs, for each of the three color channels can be stated as follows: 

so Red = [((MISkJ+MkeYRass^ 

Green = [((MI/kJ+Mk e )*Ga sampl J+[(MI^ 
Blue = [((Ml d *kS+Mk e yBa $ampt J+[W 

Gradient Magnitude Square Root Approximation 

55 

[0068] As stated above, the gradient magnitude \G\ is derived from a square root approximation of |G 2 |. The approx- 
imation is based on a Newton-Raphson approximation. Generally, Newton's method involves numerous iterations to 
find the square-root of an input number. Recall from above the input is: 
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\G 2 \ = (G U *G U )+(G V *G V )+(G W *G W ) 

For the purpose of determining the gradient magnitude, the accuracy of the square root is not as critical as the number 
of gates in a pipelined a hardware implementation. Therefore, this embodiment uses a one step version of the method. 
s [0069] The next section will discuss the Newton-Raphson method for approximating square roots that is commonly 
used in the prior art in an iterative non-pipelined fashion, (non-pipelined) followed by the details on a preferred imple- 
mentation for a pipeline, and its advantages over prior art approximations. 

Newton-Raphson 

10 

[0070] The Newton-Raphson method is an iterative algorithm, based on tangents and their midpoints along a speci- 
fied curve, in this case, the square root curve. The method works as follows: 

1. First, an intelligent guess (g) of the answer is derived based on the input number (n). 
15 2. Next, the result of dividing the input number by the guess is derived (div): 

div = n/g 

3. Then, an error is computed to determine how far off the guess was: 

20 

error = |d/V-g| 

If g had been the exact answer, it is easy to see how the error would be zero. 

4. If the computed error is too large, a new guess is ventured by computing 

25 the midway point along a tangent, defined by a line drawn between the current guess (g) and d/V, as follows: 

g = 1/2*(g+div) 

5. Steps 2 through 4 are repeated (iterated) until the error is within acceptable limits. 

30 

[0071] Figure 12 graphically shows how the Newton-Raphson method for an example number 163. In Figure 12, the 
x-axis indicates the input number, and the y-axis the square root. The curve 1200 plots the square root function. The 
input number (163 is located between the two power-of-two numbers: 128 (2 7) and 256 (2 8 ). Thus the computed square 
root of the lower bound (128) is chosen for the first guess. This is 1 1.3137. The division result, dividing the input number* 
35 (163) by the guessed answer 11.3137 yields 14.4073. This results in an error of 3.093 (14.4073-113137). The next - 
guess is computed as follows: 

NewGuess = 1/2*( 11.3137+14.4073) = 12.8605 

40 This process would then continue to whatever precision is desired. The correct answer is 1 2.767145. 

[0072] Note, this method uses both division and iteration. Division is extremely expensive in circuitry, and iteration 
inconsistent with a pipelined architecture. The multiplication by 1/2 can be accomplished by a simple shift right of the 
binary number. There are also a subtraction and possible complement, e.g., another adder, and an addition required for 
each iteration. 

45 

Prior Art Hardware Implementations 

[0073] Most prior art hardware implementations of Newton-Raphson's method for approximating a square root use 
an iterative, non-pipelined implementation. This is in order to reduce the number of required gates for the design. If the 

so typical design is converted to a pipelined implementation, the divider, adders, and subtracter would have to be repli- 
cated in successive pipeline stages, once for each iteration. Moreover, a pipelined implementation cannot support a 
variable number of steps; instead, circuitry would have to be replicated as many times as the maximum number of 
guesses. This would result in an large number of gates. Many implementations take as many as 20 or 30 iterations to 
compute a result which would introduce a huge amount of delay and circuitry into a pipelined architecture. 

55 [0074] As an example implementation, the Synopsys company offers a square root circuit (DW02_sqrt: Combinatorial 
Square Root) in their DesignWare library based on Newton-Raphson, see "www.synopsys.com." These are non-pipe- 
lined devices of which there are two variants with the following typical characteristics: either 300 ns and 9000 gates, or 
600 ns and 1100 gates based on a cycle time of approximately 10 nanoseconds. These, of course, reuse the same 
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divider, adder, and subtraction circuits for each of 30-60 iterations, precluding pipeline operation. 
Pipelined Square Root 

5 [0075] A preferred implementation is based on Newton-Raphson's method but varies significantly in that it is pipe- 
lined. The present implementation employs only one iteration and assumes predefined estimates of the square root at 
predefined points along the curve 1200 and tangents with pre-defined "slopes" connected, end-to-end, to approximate 
the square root function. As a further requirement in order to minimize the number of gates, division and multiplication 
are not used, and all computations are merely shifts and adds. 

10 [0076] The invention takes advantage of the fact the square root of a number expressed as a power-of-two (2") is 
2P 12 . So, a first approximation is made by a simple range determination. For a given input find a nearest power-of-two 
number, and use its square root as the first guess. Now, if the range check is done for odd powers-of-two (i.e., in 2 n , n 
is odd), the first approximation will be in the middle of a range reducing the largest possible error by half. 
[0077] Figure 13 is a block diagram of a preferred implementation of a square root approximation unit 1300. The unit 

15 includes a combinatorial logic block 1310 labeled "Select Range & Guess," another block of combinatorial logic 1320 
labeled "Divide Input by Guess," an adder 1330, and a shifter 1340. The unit 1300 takes a number (for example, |G 2 |) 
as input 1 301 , and produces an approximated square root as output 1 309. 

[0078] Essentially, the block 1310 determines guess 1311 and shift 1312. The value guess is the nearest square root, 
expressed as a power-of-two number, of a largest odd power-of-two number less than or equal to input. This range test 
20 can be as a simple bit test operation. The range test can begin at 32,768 (hex 0x8000 or 2 15 ) which has a nearest 
square root of 256 (2 8 ). In other words, because n is odd, the root is "guessed" as 2 (n+1 ) /2 . The corresponding initial 
guess is 256, and shift is 8. 

[0079] Block 1320 divides input by guess. Because guess is a power-of-two, the divide can be done as simple shift 
operation. The adder 1 330 adds guess to the result of input /guess, The shifter 1 340 implements the final divide by two: 

25 

output = (guess+(input/guess))l2, or 
output = (2( n+1 > t2 +(input/2< n+1 > /2 )t2. 

By choosing a good value for guess, that is make n odd, the approximation is very accurate. 
30 [0080] Because guess is always a power-of-two, the divide is simplified to a shift of the input. Then, according to the 
Newton-Raphson method, the guess is added to the result of dividing the input by the guess by the adder 1340. The 
sum is then divided by two in the shifter 1340 to give a close approximation of the square root of the input. 
[0081] Taking the same example as was used above, if the input is 163, then the input >= 0x0080 or 128 (2 7 ), and 
the guess is 16 (shift 4), and 

35 

output = (16+(163/16))/2 = 13, 
that is, the square root of 163 rounded to the nearest integer. 

[0082] Figure 14 is a graph 1400 comparing the exact gradient magnitude 1401 with the approximate gradient 1402, 
40 and the error in the approximation 1403. 

[0083] This circuit requires a very small number of gates to implement. Additionally, it the circuit is well suited to a 
pipelined design as the logic may be spread over as many pipe stages as desired without having to replicate any logic 
because no loops or iterations are involved. An actual implementation of the circuit 1300 takes 850 gates and has a 
propagation delay of 5 nanoseconds, compared with 300 Ns and 9000 gates from above. 

45 

Generalized Function Approximation 

[0084] At first blush, it might appear that the above described single iteration of Newton-Raphson can easily be 
extended to a fixed number of additional iterations in a pipelined fashion to improve precision. However, the method 
so described above relies on all computations involving powers-of-two. This will no longer be the case in a second, follow- 
on iteration. In the second iteration, it is necessary to use the result from the first iteration in the divide operation. The 
result will most likely not be a power-of-two number, so a complex divider circuit would have to be used, which would 
be very costly in gates and delays. 

[0085] However, the method can be improved to provide a better approximation without increasing the number of iter- 
55 ations, but rather by piecewise linear approximation of the square-root function that involves division by a fixed set of 
numbers that are not powers of two. The set of numbers is chosen so that division can still be accomplished by a small 
number of shifts and adds in a fixed number of steps. 

[0086] Consider for example the range of guesses 1310 in Figure 13. Suppose that the difference between possible 
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guesses 128 and 256 is too great for the level of accuracy desired. It really is desired to select a guess part way 
between these two, and still be able to obtain the quotient input/guess efficiently. One way is to take the average of 
input/128 and input/256, a number that is easy to compute with an additional adder and shift. Let n be the input number 
as above. Then the average (n/128)+(n/256))/2 is given by 

5 

((n/128)+(n/256))/2 = (n/256+2n/256)/2 = 3n/512 = n/(512/3). 

[0087] That is, simply sum the number n shifted by seven bits with the number n shifted by eight bits, then shift the 
result by one bit. This turns out to be the same as dividing n by 512/3, which is approximately 170.667, or nearly 171. 
10 The division is accomplished with an adder and two shifts, which is much more effective than a full divider circuit. 
[0088] The effect is to decrease the size of the ranges for the first guess by doubling the number of points at which 
first "guess" is taken of the square root of the input. This reduces the maximum error shown in Figure 14 in this modified 
single-step approximation of the square root. 

[0089] Note that the precision of the approximation can be increased even more by increasing the number of adders 
15 and shift operations performed in the single step. For example, the following 3rd order approximation requires two 
adders and three shifts: 

n/256 = n » 8 

n/204 » (n/256+n/171) » 1 = (n/256+((n/256+n/128) » 1)) » 1 
20 n/171 m (n/256+n/128) » 1 

n/146 « (n/171+n/128) » 1 = (((n/256+n/128) » 1)+n/128) » 1 
n/128 = n»7 

[0090] Another way of considering this is to note that by combining different shifted-down values in different ways, 
25 many differently sloped tangents can be produced along the curve representing the square root function. In a preferred 
method, the starting point is selected from a range including the input number, and the sloped" tangent to be applied 
from that point to the next range. 

[0091] In general, suppose that the range of the square root function has the following predetermined guesses: 

30 9o>9i,92 9i,9i+h- 

where the g,- are chosen so that division can be accomplished by a fixed set of circuitry in a fixed amount of time. Then 
the choice of guesses can be predetermined to minimize the amount of error between the guess and the actual square 
root. Specifically, if the input value n lies between g f 2 and g i+1 2 , then the error in the approximation based on the these 
35 two guesses will be 

rt(n/g r gj) and 1 /4(p /+r n/p /+1 ; t 

respectively. The value of n below which g } is a better guess and above which is a better guess is the value for 
40 which these two errors are equal - i.e., for which 

*M"l9r9i) = iM9i+i-nl9i+ih 

Solving for n, it can be seen that if n < gfgj+i, then g, is the better guess, otherwise g i+1 is the better guess. 

45 [0092] Therefore, for the sequence of guesses g^ g h g 2 , .... p„ there is a corresponding sequence of selection 
ranges go*g 1% g*g^ 92*93, -» 9 t *9i+h against which n is tested in block 1310 of Figure 13. So rather than having 
guesses spaced at odd powers-of-two in large ranges that are powers-of four apart (2, 8, 32, 128, 512, 2K, 8K, 32K) as 
in block 131 1 , one can have them spaced any difference apart, even different distances for the same function. 
[0093] While this description is specific to the square root function, the method and apparatus as described above 

so can be generalized to approximating any function, linear or non-linear. The function resolved is represented by suffi- 
cient connected tangents to approximate the function. Starting points defining the range of the tangents can be stored 
as a table along with the initial guesses and slopes. Then, simple logic similar to the logic described with reference to 
Figure 13 can be used to approximate arbitrary functions to whatever level of precision with a minimal number of gates 
in a pipelined manner. 

55 [0094] It is to be understood that various other adaptations and modifications may be made within the spirit and scope 
of the invention. Therefore, it is the object of the appended claims to cover all such variations and modifications as come 
within the true spirit and scope of the invention. 
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Claims 

1. An apparatus for generating lighting modulation factors for samples in a volume rendering pipeline, comprising: 

s a first arithmetic logic unit squaring a gradient magnitude vector of a sample to produce a squared gradient 

magnitude; 

a second arithmetic logic unit producing a gradient magnitude from the squared gradient magnitude; 
a shift register, connected to the first arithmetic logic unit, truncating a predetermined number of high bits of the 
squared gradient magnitude; 
10 a gradient magnitude modulation register storing modulation parameters; 

a first multiplexer, connected to the second arithmetic logic unit and the shift register, selecting the truncated 
squared gradient magnitude as an index if an index source signal is true, and the gradient magnitude if the 
index source signal is false; and 

a memory table indexing by the index to produce modulated opacity, emissive, diffuse and specular modulation 
15 factors. 

2. The apparatus of claim 1 further comprising: 

a high pass filter circuit filtering the diffuse and specular modulation factors below a predetermined point. 

20 

3. The apparatus of claim 2 further comprising a second multiplexer connected to the table and the high pass filter for 
selectively modulating the opacity, emissive, diffuse and specular modulation factors according to user supplied 
control parameters. 

25 4. The apparatus of claim 1 further comprising: 

a gradient magnitude range register storing a minimum gradient and a maximum gradient of a valid gradient 
range; 

a comparator connected to compare the squared gradient magnitude with the maximum and minimum gradi- 
30 ents to produce a range valid signal. 

5. The apparatus of claim 1 wherein the gradient magnitude vector has components G^, Gy, and G w , and further 
comprising: 

35 means for summing the squares of the components to determine the squared gradient magnitude. 

6. A method for generating lighting modulation factors for samples in a volume rendering pipeline, comprising: 

squaring a gradient magnitude vector of a volume sample to produce a squared gradient magnitude; 
40 producing a gradient magnitude from the squared gradient magnitude; 

truncating a predetermined number of high bits of the squared gradient magnitude; 
storing modulation parameters in a gradient magnitude modulation register; 

selecting the truncated squared gradient magnitude as an index if an index source signal is true, and the gra- 
dient magnitude if the index source signal is false; and 
45 indexing by the index to produce modulated opacity, emissive, diffuse and specular modulation factors. 
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(54) Method and apparatus for modulating lighting in a rendering pipeline 



(57) An apparatus generates lighting modulation 
factors for samples in a volume rendering pipeline. The 
apparatus includes a first arithmetic logic unit squaring 
a gradient magnitude vector of a sample to produce a 
squared gradient magnitude. A second arithmetic logic 
unit produces a gradient magnitude from the squared 
gradient magnitude. A shift register, connected to the 
first arithmetic logic unit, truncates a predetermined 
number of high bits of the squared gradient magnitude. 



A gradient magnitude modulation register stores modu- 
lation parameters. A first multiplexer, connected to the 
second arithmetic logic unit and the shift register, selects 
the truncated squared gradient magnitude as an index 
if an index source signal is true, and the gradient mag- 
nitude if the index source signal is false, and a memory 
table is indexes by the index to produce modulated 
opacity, emissive, diffuse and specular modulation fac- 
tors. 
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